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Parallel processing method in neural network system, involves 
transferring manipulated data from secondary chips to central processor, 
and processing by manipulating data using Brownian motion equations and 
matrices or Bayes 'equation 
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US 20050090908 Al G05B-019/18 Provisional application US 2002462323 

Abstract (Basic) : WO 200517647 A2 

NOVELTY - The data manipulated in primary chips (21) is transferred 
to secondary chips (47) including Brownian motion equations coded for 
specific entity and vectors that are series of matrices with elements 
of Bayes ' equation for specific entity. The data from secondary chips is 
transferred to central processor and processed by manipulating data 
using Brownian motion equations and matrices or Bayes 1 equation. 

DETAILED DESCRIPTION - An INDEPENDENT CLAIM is also included for 
parallel processing neural network system. 

USE - For performing parallel processing in neural network system 
(claimed) used in medicinal, biomedical and chemical fields, and other 
applications such as drug design, toxicology, business management, 
earthquake prediction, biotechnology, personnel selection, training and 
upgrading, air traffic control and management file, global decision 
making, domestic decision making, crime prevention and detection, food 
and water supply and demand, weather prediction, oil exploration, 
environmental pollution, plasma physics, stock market prediction, 
computer security and aerodynamics applications, using software engine. 

ADVANTAGE - Handles large data array that incorporates data from 
past and present in many fields, and increases the possibility of 
incorporating the ubiquitous randomness in the real world and integrate 
data from laboratory and academic worlds. Unique software engine is 
designed to deal with real world events in any time interval. 

DESCRIPTION OF DRAWING (S) - The figure shows the top schematic view 
of software engine. 

input unit (2) 

software converter (7) 

bus bar (11) 

primary chip (21) 



secondary chip (47) 
pp; 26 DwgNo 2/5 
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Data transmission/reception system has base station to send notification 
with information regarding allocated channel to requesting and other 
mobile terminals, such that other terminals selectively download reserved 
contents 

Patent Assignee: NEC CORP (NIDE ); FUKUIZUMI T (FUKU-I) ; TAMURA R (TAMU-I) 
Inventor: FUKUIZUMI T; TAMURA R 

Number of Countries: 002 Number of Patents: 002 
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US 20030186704 Al 46 H04Q-007/20 

JP 2003283422 A 30 H04B-007/26 

Abstract (Basic) : US 20030186704 Al 

NOVELTY - The radio base station (2) allocates a prescribed channel 
for a mobile terminal (1) when the mobile terminal requests for an 
immediate download of the content. The radio base station sends 
notification including information regarding the allocated channel to 
other mobile terminals in the radio communication zone, such that each 
mobile terminal tunes into the channel to selectively download the 
reserved content. 

DETAILED DESCRIPTION - INDEPENDENT CLAIMS are also included for the 
following: 

(1) mobile terminal; 

(2) content server; 

(3) radio base station; and 

(4) data transmission/reception method. 

USE - Data transmission/reception system e.g. CDMA radio 
communication system, W-CDMA radio communication system, TDMA radio 
communication system and FDMA radio communication system for 
transmitting/receiving data such as moving images and music on cellular 
phone, personal digital assistant (PDA) and personal handy phone system 
(PHS). 

ADVANTAGE - Since other mobile terminals are simultaneously 
downloading the reserved contents, the user can receive and obtain 
desired contents at desired time. Alleviates shortage of line capacity 
for delivering rich contents and reduces communication charge. 

DESCRIPTION OF DRAWING (S) - The figure shows the data 
transmission/reception system. 

mobile terminals (1) 

radio base station (2) 

wireless communication network (4) 

transmission/reception system (100) 

pp; 46 DwgNo 3/23 
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Insurance contract method e.g. for life insurance, involves storing 
transmitted information including insurance contract, corresponding to 
the information received from server * 

Patent Assignee: NEC CORP (NIDE ) 
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Number of Countries: 004 Number of Patents: 004 
Patent Family: 
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Abstract (Basic) : US 20030055767 Al 

NOVELTY - The information including the insurance for a new 
contract, contract change or contract renewal, is transmitted from a 
portable terminal (100) to an insurance server (200) through a network 
(400) . The information received from the server is stored corresponding 
to the transmitted content in the portable terminal. 

DETAILED DESCRIPTION - INDEPENDENT CLAIMS are also included for the 
following: 

(1) portable terminal; 

(2) computer program product for insurance contract; and 

(3) insurance contract system. 

USE - E.g. for life insurance, transportation insurance, fire 
insurance, fiduciary insurance. 

ADVANTAGE - Enables the user's to surely and easily manage the 
insurance subscribed through the portable terminal. Promptly achieves 
renewal of insurance and change of contract content whenever and 
wherever necessary through the portable terminal . Performs control 
based on insurance menu provided, suitably for individual user. 

DESCRIPTION OF DRAWING (S) - The figure shows the block diagram of 
an insurance contract system, 
portable terminal (100) 
insurance server (200) 
network (400) 
pp; 57 DwgNo 1/27 
Title Terms: INSURANCE; CONTRACT; METHOD; LIFE; INSURANCE; STORAGE; 
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RECEIVE; SERVE 
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Facility for responding to information consumer enquires, comprises a 
real time inquiry response system using a database having a number of 
stored responses corresponding to inquires made by the consumer 
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H04N-007/173 Provisional application US 2000255800 



Abstract (Basic) : WO 200248896 Al 

NOVELTY - The system for providing demand responses to inquiries 
made by information consumers (11) includes a database having a number 
of stored responses (45b) corresponding to inquiries made by an 
information consumer. Each of the stored responses (45b) contains at 
least one stored. item returnable to an information consumer in response 
to an inquiry. The returnable item of the stored response is of a 
preferred presentation media type that most effectively presents the 
returnable item. 

DETAILED DESCRIPTION - A real time inquiry response system (13) 
receives inquiries submitted by information consumers from devices 
having a communication interface. Means are provided for correlating 
the consumer inquiries received by the real time inquiry responses 
stored within the database . The system further includes 
device/ interface identification means for identifying the 
communications interface and the communications device. The item of the 
stored response is returned to a communications device having the 
communications interface which is compatible with the media type of the 
item of the stored inquiry response. The media type of a stored item of 
the inquiry response can further be transformed to a different 
transformed media type in response to an inquiry requiring the 
presentation of the item of the stored response in the transformed 
media type . 

USE - Facility for responding to information consumer enquires. 



DESCRIPTION OF DRAWING (S) - The drawing shows a block diagram 
showing the system accessed through a telephone system and the 
Internet . 

Information consumers (11) 

Real time enquiry response system (13) 

Stored responses (45b) 
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IC card recording and/ or reproducing device 

cards 
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Abstract (Basic) : WO 200195244 Al 

NOVELTY - Device provides storing unit for memory cards, card 
read/write unit and moving mechanism for relatively moving/controlling 
storing unit or read/write unit to move to position to permit data 
reading/ writing w.r.t memory card in storing unit. Moving mechanism is 
used to selectively take out memory card stored for data 
reading/writing. Storing unit permits part of label pasted on memory 
card to be visible to be read from outside while kept stored. 

USE - IC card storage unit with recording and/or reproducing device 
for storing data on IC memory cards. 

DESCRIPTION OF DRAWING ( S ) - Diagram of IC card storage unit. 

IC card (1) 

USB connector (29) 

pp; 134 DwgNo 4/59 
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(c) 2005 European Patent Office. All rts. reserv. 

01886898 

SOFTWARE ENGINE FOR MULTIPLE, PARALLEL PROCESSING WITH NEURAL NETWORKS 
MOTEUR DE LOGICIEL POUR EXECUTION MULTIPLE SIMULTANEE AVEC DES RESEAUX 
NEURONAUX 

PATENT ASSIGNEE: 

Tamura, Raymond M. , (5150870), 90 Nakolo Place, Room 6, Honolulu, HI 
96819, (US), (Applicant designated States: all) 
INVENTOR: 

Tamura, Raymond M. , 90 Nakolo Place, Room 6, Honolulu, HI 96819, (US 
PATENT (CC, No, Kind, Date): 

WO 2005017647 050224 
APPLICATION (CC, No, Date) : EP 2004775879 040412; WO 2004US11118 040412 
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EXTENDED DESIGNATED STATES: AL; HR; LT; LV; MK 
INTERNATIONAL PATENT CLASS: G06F-001/00 
LEGAL STATUS (Type, Pub Date, Kind, Text) : 
Application: 050420 A2 International application. (Art. 158(1)) 

Application: 050420 A2 International application entering European 

phase 

LANGUAGE ( Publication, Procedural , Application) : English; English; English 
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03796019 INSPEC Abstract Number: C91007329 
Title: Identification of membership functions by neural networks 

Author (s) : Ishibuchi, H.; Tanaka, H.; Tamura, R. ; Fujioka, R. 

Author Affiliation: Coll. of Eng., Osaka Prefecture Univ., Sakai, Japan 

Journal: Transactions of the Institute of Electronics, Information and 
Communication Engineers D-II vol.J73D-II, no. 8 p. 1227-32 

Publication Date: Aug. 1990 Country of Publication: Japan 

CODEN: DTGDE7 

Language: Japanese Document Type: Journal Paper (JP) 
Treatment: Theoretical (T) 

Abstract: Proposes some identification methods of membership functions 
using neural networks . First, the authors propose an identification 

method of a continuous real-valued membership function using the 
back-propagation method when the membership values of finite data points 
are given. The input-output function of an output unit is somewhat modified 
in order to consider the output of a neural network as a membership 
value. Next, the authors propose a method to identify an interval-valued 
membership function. The cost function to be minimized in the 
back-propagation method is replaced by a weighted sum of squared errors. 
Last, the authors propose a method to identify a membership function of a 
fuzzy set of type 2. (7 Refs) 

Subfile: C 

Descriptors: identification; neural nets; set theory 

Identifiers: neural networks ; identification methods; continuous 
real-valued membership function; back-propagation method; finite data 
points; input-output function; output unit; interval -valued membership 
function; cost function; weighted sum of squared errors; fuzzy set 
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00508369 INSPEC Abstract Number: C73010018 
Title: Innovative approach to predictive utilization of medical services 
Author(s): Tamura, R.M. 

Author Affiliation: Univ. Hawaii, Honolulu, HI, USA 

Conference Title: Proceedings of the 6th Hawaii International Conference 
on Systems Science. Supplement p. 29-31 
Editor(s): Lew, A. 

Publisher: Western Periodicals, North Hollywood, CA, USA 
Publication Date: 1973 Country of Publication: USA xiv+227 pp. 
Conference Sponsor: Univ. Hawaii; US Army Res. Office; IEEE; et al 
Conference Date: 9-11 Jan. 1973 Conference Location: Honolulu, HI, USA 
Language: English Document Type: Conference Paper (PA) 
Treatment: Theoretical (T) 

Abstract: Classic methodology for attaining solutions to problems which 
are not linear in nature has failed repeatedly. Bayesian methodology is 
essentially non-linear, and it is simulated by the equation for brownian 
motion which describes, and most importantly, predicts future random paths. 
This equation also permits the consideration of multiple factors with rapid 
reiteration and multiple regression analysis. (4 Refs) 

Subfile: C 

Descriptors: Bayes methods; biocybernetics ; nonlinear systems 
Identifiers: predictive utilization; medical services; Bayesian 

methodology; brownian motion; multiple regression analysis; nonlinear 

systems 
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02952262 Genuine Article#: MU155 Number of References: 6 

Title: A RANDOMIZED PLAY- THE -WINNER DESIGN FOR MULTIARM CLINICAL- TRIALS 

Author (s) : ANDERSEN J; FARIES D; TAMURA R 

Corporate Source: ELI LILLY & CO, LILLY CORP CTR/ INDIANAPOLIS/ /IN/ 462 85 
Journal: COMMUNICATIONS IN STATISTICS -THEORY AND METHODS, 1994, V23, N2 , P 

309-323 
ISSN: 0361-0926 

Language: ENGLISH Document Type: ARTICLE 
Geographic Location: USA 
Subfile: SciSearch 

Journal Subject Category: STATISTICS & PROBABILITY 

Abstract: A randomized adaptive allocation scheme is a design in which the 
probability a treatment is administered to each patient depends upon 
the results of the previous patients in the study. Typically, an arm 
that is doing well is more likely to be allocated to future patients 
than an arm that is doing poorly. Occasionally, ethical and/or 
practical considerations suggest that such designs may be appropriate. 
However, many issues need to be addressed in order to run the trial 
properly. Among these are studies with more than two arms, the 
logistics behind the trial, delayed patient response, and inferences 
drawn from data collected in this manner. This paper demonstrates ways 
these issues can be resolved, and presents some modifications to the 
current literature. A simulation study demonstrates the operating 
characteristics of the design. 
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Impairment diagnosis in communication system, uses probabilistic 
modelling for diagnosing and analyzing impairments in multi- processor 
computational architecture, with multiple Bayesian hypothesis tests 
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Abstract (Basic) : WO 200135607 Al 

NOVELTY - The inventive method Includes application of one or more 
of the following techniques: (i) Compilation of statistical models of 
physical layers of a communication system; (ii) creating, from general 
principle deduction, distributions of crosstalk transfer functions; and 
(iii) storing the models and distributions in a suitable medium for use 
in diagnosing probable causes of events detected in the system. The 
method provides control for managing upstream/ downstream data. Agents 
may be implemented in NAMS (Network Access Management System) (1110), 
access multiplexers (1130) and/or user equipment (1140), e.g. receivers 
containing modems. Agents include system software modules (1170), 
embedded in NAMS (1110), and transceiver software modules (1160), 



embedded in access multiplexers (1130) and/or user equipment (1140) . 

USE - For estimating likely causes of communication network 
disturbances such as crosstalk noise, in e.g. cellular telephone 
wireless telecommunication networks . 

ADVANTAGE - Provides user of such networks with capability to 
analyze, diagnose and/or compensate for signal interference/ impairment , 
also providing ability to predict/optimize system performance in 
presence of impairments, so guarding against unforeseen loss of 
service, e.g. diagnosing probable offenders causing given impairment, 
by using Bays si an estimation techniques, static and dynamic, for 
statistical parameter estimation and hypothesis testing. 

DESCRIPTION OF DRAWING (S) - The drawing illustrates in block 
diagram form an example system (1105) benefiting from the inventive 
method of analysis/diagnosis, 
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Abstract (Basic) : US 5539704 A 

The method includes assembling in programmed computer including 
data processor , first measurements of primary variable at a number 
of control pixels and second measurements of associated secondary 
variable at all pixels of array, estimating the mean and variance of 
Gaussian prior distribution of primary variable from first measurements 
and estimating the joint probability distribution of the primary and 
secondary variables from a scatter diagram of the first and second 
measurements at the control pixels. An as-yet unsimulated pixel is 
selected at random, estimating the Gaussian conditional probability 
distribution of the primary variable at the selected pixel by kriging 
primary data at control pixels within a selected search region 
encompassing selected pixel . 

A unidimensional slice is extracted through the joint probability 
distribution corresp. to a measured value of secondary data at selected 
pixel. The posterior probability distribution is calculated in the 
processor for primary variable at the selected pixel by taking the 
product of the probability ratio and the extracted one -dimensional 
slice, and a simulated value is drawn for the primary variable at 
selected pixel by sampling at random from the posterior probability 
distribution. The simulated value of the primary variable is entered 
into the array at selected pixel as additional control pixel, and the 
process is repeated until the primary variable is simulated for all 
pixels of the array. 

ADVANTAGE - Method may be extended to array of volume elements or 
voxols in three-dimensional space. 
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ABSTRACT 



PROBLEM TO BE SOLVED: To provide a system for stereoscopically matching a 
video image sequence real time. 

SOLUTION: A real time stereoscopic video matching system comprises a video 
processing unit 12 for converting videos input from left and right side 
cameras 10 and 11 into digital signals, calculating a prescribed matching 
cost from pixel pair of one scanning line of the converted digital video 
signals, tracing a deciding value for deciding a minimum matching cost, and 
outputting a decided value by prescribed active information for deciding 
whether it is operated or not as a binocular difference inferred value. 
Thus, an effect capable of stereo matching real time by parallel 

processing the video image sequence by using an algorithm based on new 
dynamic programming optimized by a B aye si an sense. 
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Handwritten numeral classifier in personal digital assistant, has 
input/output circuit that outputs recognizing result of scanned image 
based on synthesis membership degrees generated using membership function 
degrees 
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Abstract (Basic) : US 20040008883 Al 

NOVELTY - An extraction unit (10) compresses received data of 
scanned image to generate feature values based on which synthesis 
membership function degrees are generated using fuzzy logic . An 
input /output circuit (18) outputs final recognizing result of scanned 
image based on synthesis membership degrees generated using function 
degrees. A controller (13) controls operation of unit (10) and 
generator. 

DETAILED DESCRIPTION - An INDEPENDENT CLAIM is also included for 
extraction unit. 

USE - Handwritten numeral classifier e.g. current mode very 
large-scale integration (VLSI) classifier, for recognizing handwritten 
character in personal digital assistant (PDA), touch-screen appliances 
in cellular neural network . 

ADVANTAGE - The real-time signal processing and high speed 
parallel processing of image is performed reliably. The robustness, 
speed and accuracy of classifier are improved, hence the normalized 
handwritten digit image is directly classified. 

DESCRIPTION OF DRAWING (S) - The figure shows a schematic diagram of 
the handwritten numeral classifier. 

extraction unit (10) 

clock generator and logic controller (13) 
11-port k-winner-takes-all (k-WTA) circuit (14) 
input /output circuit (18) 
membership function generator (19) 
pp; 12 DwgNo 1/6 

Title Terms: HANDWRITING; NUMBER; CLASSIFY; PERSON; DIGITAL; ASSIST; INPUT; 

OUTPUT; CIRCUIT; OUTPUT; RECOGNISE; RESULT; SCAN; IMAGE; BASED; SYNTHESIS 

; MEMBER; DEGREE; GENERATE; MEMBER; FUNCTION; DEGREE 
Derwent Class: T01; T04 

International Patent Class (Main) : G06K-009/00 

International Patent Class (Additional) : G06E-001/00; G06E-003/00; 

G06F-015/18; G06G-007/00; G06K-009/62 
File Segment: EPI 



17/5/5 (Item 5 from file: 350) 

DIALOG (R) File 350:Derwent WPIX 

(c) 2005 Thomson Derwent . All rts. reserv. 

014522313 **Image available** 

WPI Acc No: 2002-343016/200238 

XRPX Acc No: N02-269768 

Compiler generating method for converting Java byte code to native 
machine code, involves encoding and training neural network in 
integrated circuit, to convert Java byte code to native machine code 
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Abstract (Basic) : GB 2365164 A 

NOVELTY - An integrated circuit with a neural network is 
encoded and trained to convert the Java byte code (12) to native 
machine code (14) that is capable of being executed on an operating 
system platform. 

DETAILED DESCRIPTION - An INDEPENDENT CLAIM is also included for 
integrated circuit chip. 

USE - For converting Java byte codes to native machine codes 
using neural networks in computer system. 

ADVANTAGE - Since the Just -In-Time neural network provides 
quick mapping from byte code to native machine code and involves 
parallel processing techniques, processing time is reduced. The VLSI 
chip with neural network has programmable logic capable of being 
retrained to map byte codes for new classes to the machine code for new 
classes . 

DESCRIPTION OF DRAWING (S) - The figure shows the block diagram of 
computing environment and components to convert byte code to machine 
code . 

Java byte code (12) 
Native machine code (14) 
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Check cycle synchronization system for computer networks, outputs 
corrected absolute time reference signal which is utilized as internal 
reference master clock to create discrete clock cycle for computer 
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Abstract (Basic) : US 6324586 Bl 

NOVELTY - A preprocessor (18) receives timing signals from global 
satellite system and outputs a corrected absolute time reference 
signal. The absolute time reference signal is utilized as an internal 
reference master clock to create discrete clock cycle for computer 
(24) . 

DETAILED DESCRIPTION - INDEPENDENT CLAIMS are also included for the 
following: 

(a) Massive parallel processing system; 

(b) Neural network ; 

( c ) Antenna assembly; 

(d) Clock cycle synchronization method for computers 

USE - For computer network such as Internet, local area network, 
wide area network. 

ADVANTAGE - Enables computer to be synchronized to the accuracy of 
atomic clock and hence interaction between the computers is 
synchronized irrespective of the location of computers in global 
network and the time delay encountered in Internet is eliminated. 

DESCRIPTION OF DRAWING (S) - Shows a schematic view of the timing 
synchronization system. 

Preprocessor (18) 

Computer (24) 
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Complex data movement method for multiprocessor system - involves 
transferring data to processor locations in first column of array by 
passing data through processor located in Mth column of array 
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Abstract (Basic) : US 5603046 A 

The method for transferring data in a data processing system 
includes storing a first data value in a first of a series of 
processors. The first processor is location in thr Nth row of the array 
and in the first column. A second data value is stored in a second 
processor which is located in the Nth row of the array and in the Mth 
column of the array. The first data and second data values are 
transferred from their respective processors to the interface circuitry 
and from the interface circuitry to the switch circuitry. 

The first data value is transferred form the switch circuitry to a 
third processor which is located in the first row of the array and in 
the Mth column. The second data value is then transferred to the 
second processor . If the switch circuitry is used to transfer data 
to one of the processors located in the first column of the array the 
data must pass through one of the processors located in the Mth column 
of the array. 

USE/ADVANTAGE - Meets requirements of fuzzy logic , neural 
networks and other parallel array orientated applications. 
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SIMD mesh parallel computer architecture for connection to host computer 
- has master processor element for broadcasting instructions to array of 
synchronous -execution slave processor elements, each contg* 
input-output processor section for routing data, and core processor 
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Abstract (Basic) : US 5590356 A 

The Monolithic Synchronous Processor (Mesh-SP) processes data 
and incorporates a mesh parallel computer architecture, primarily SIMD, 
Each Mesh-SP processor node utilizes a single DSP processor element, a 
large internal memory of at least 128k-bytes, and separately operable 
computational and 1-0 processing sections. 

The processor element provides data throughput of at least 120 
MFlops. The processor is programmed in ANSI C and without parallel 
extensions. A combination of on-chip DMA hardware and system software 
simplifies data 1-0 and inter-processor communication. A functional 
simulator enables Mesh-SP algorithms to be coded and tested on a 
personal computer . 

USE/ADVANTAGE - Combines high data throughput with modest size, 
weight, power and cost. Facilitates software development. Mesh-SP 
appears to programmer as single computer which executes single program, 
reducing programming complexity. Mesh-SP is programmed to solve wide 
variety of computationally-demanding signal processing problems, e.g. 
three-dimensional graphics or multi-dimensional signal processing, 
neural networks , tomographic reconstruction, large Fourier 
transforms and solving linear equations. 
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Abstract (Basic) : EP 619557 A 

The data processor has a first port, north and west (44,50) and a 
second port, south and east (48,46). A storage circuit stores a number 
of control values (PCR) (52). A switch circuit is coupled between the 
two ports. The circuit is in either a conducting mode or a 
non-conducting mode in response to a first one of the control values. 

A tap circuit is coupled between the first port and the second 
storage circuit. The tap circuit is in either mode in response to a 
second control value. 

ADVANTAGE - Data processor is capable of performing both vector 
operations and scalar operations . 
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Neural processor with distributed synaptic cells - uses synaptic cells 
c ommu nicating over chained paths that can be grouped and interrupted in 
part 
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Abstract (Basic) : EP 558125 A 

The neural processor has multiple synaptic cells (SYN 1 - SYN 
P) that are addressed in parallel by an address bus (21) and by an 
operation type bus (23) . The cells communicate over a data chain (22) 
and a chained path (24) propagating an occupation signal. Each synaptic 
cell determines itself its proper contribution to the overall result. 

The synaptic cells can form groups of synaptic cells, having a 
chained data path in each group. The chained paths can be interrupted 
by pipeline barriers so that the cycle times can be reduced. 

ADVANTAGE - Neural processor with configuration free of topological 
constraints and capable of dynamic modification of configuration, 
giving improved performance and optimum use of silicon. 
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Parallel processing network for neural network computers - 

includes stacked planes of unit cells with chalcogenide body which can be 

set and reset to different values of physical property 
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Abstract (Basic) : EP 479325 A 

Parallel processing network comprises parallel data inputs and 
parallel distributed processing means including stacked planes of unit 
cells each formed of a chalcogenide body with a data input and output. 
The body may be set and reset to different values of a given physical 
property and the values determine the pattern and strength of the 
interconnections between the unit cells. The values of the chalcogenide 
body are pref. set and rest by applying an electric signal, pref . via 
the data input means . 

The chalcogenide materials pref. includes C , Si, Ge, Sn, Pb, P, 
As, Sb, F, 0 or Bi. 

USE/ADVANTAGE - In construction of neural network computing 
systems (claimed) . The degree of connectivity between individual 
neurons may be set and reset over a large dynamic range, resulting in a 
computer having the ability to learn from and adapt to various data 
inputs . 

Dwg. 1/6 

Title Terms: PARALLEL; PROCESS; NETWORK; NEURAL; NETWORK; COMPUTER; STACK; 

PLANE; UNIT; CELL; CHALCOGENIDE; BODY; CAN; SET; RESET; VALUE; PHYSICAL; 

PROPERTIES 
Derwent Class: L03 ; R27; T01 

International Patent Class (Main) : G06F-015/76; G06F-015/80; G11C-013/00 
File Segment: CPI; EPI 



17/5/31 (Item 31 from file: 350) 

DIALOG (R) File 350:Derwent WPIX 
(c) 2005 Thomson Derwent. All rts. reserv. 

008293429 **Image available** 
WPI Acc No: 1990-180430/199024 
XRPX Acc No: N90-140237 

Retro-propagation of errors in neutral network - uses multiple 

processors with two processing groups to compare results of learning 

from examples, and back propagates errors 
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Abstract (Basic) : EP 372613 A 

The error retro-propagation is used in a layered neural network 
. The first step is a resolution process which determines for each 
layer the states of the output neurons relative to the states of the 
input neurons. The next step is the updating of the synaptic 
coefficients (Cij) during a learning process using teaching by example. 

The system uses two groups of computation functions implementing a 
learning phase operating on two examples . The implementation of the 
retro-propagation algorithm is in the second processing group. The 
desired neuron output state is compared with the actual neuron output 
state, and any errors are propagated backwards through the network. The 
synaptic coefficient matrix and the transposed matrix of the second 
group are generated simultaneously. 

USE/ADVANTAGE - E.g. in recognition of characters, or forms. 
Improved processing speed in layered neural network implemented on 
parallel computation architecture. (13pp Dwg.No.1/3) 
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Neutral net structure for speech processing - uses integrated circuits 

for storing synaptic coefficients and states, and for multiplication, 

adding, and transcoding 
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Abstract (Basic) : EP 322966 A 

The neural net processing circuit comprises a programmable 
digital memory (20) which holds the synaptic coefficients for the 
neural net , a digital state memory (21) , multipliers (31) , an adder 
tree (33) and a transcoder module (12). These circuits can be grouped 
as a set of modules to implement a larger neural net . 

The structure can operate in parallel, simultaneously processing 
the synaptic coefficients and performing computations relative to the 
neural net . The synaptic coefficients and the states of the neurons 
have several possible encodings to satisfy various possible net 
computations. 

USE/ADVANTAGE - Integrated circuit which can be used as basic 
unit for construction of complex neural nets which operate at high 
speed, for application in shape and character recognition, in image and 
speech processing, and combinatorial optimisation. 
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ABSTRACT 



PROBLEM TO BE SOLVED: To solve the problem of even though images can be 
processed simultaneously with a microarray in parallel in a microarray 
technique, the processing speed of an analytical technique using a digital 
microprocessor is limited and the efficiency of the technique is disturbed. 

SOLUTION: The system, by which an image containing the matrix of spots, 
such as the images or the like of a hybridized DNA microarrays after 
hybridization has been conducted, is provided. The system is provided with 
a circuit 20 which processes an image signal corresponding to the images. 
The circuit is constituted on the basis of the architecture of a cellular 
neural network (CNN) for the parallel analog processing of the image 

signal. The circuit can be related to a sensor 10 acquiring the images, and 
it can be integrated with a single monolithic component, on which a VLSI 
CMOS technique is mounted. 

COPYRIGHT: ( C ) 2002, JPO 
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ABSTRACT 



PROBLEM TO BE SOLVED: To provide an information processor for which 
experiment on a large- scale neural network allowing plural 

processor units to independently and quickly operate, and transmitting 
neuron outputs in a simple control system is carried out. 

SOLUTION: This information processor is provided with a neuron output 
preservation memory 16 constituted of plural memory blocks 141-14n+l having 
the same physical address, plural processor units 101-10n connected 
with each memory block 141-14n one to one for independently performing a 
neuron arithmetic operation, and for writing the obtained neuron output 
values in preliminarily designated addresses, plural synapse coefficient 
memories 121-12n for storing synapse coefficients necessary for the neuron 
arithmetic operation assigned to the connected processors units 101-10n, a 
convergence judging circuit 18 connected with one memory block 14n+l for 
judging the convergence of the fluctuation of values to be written in the 
memories of the preliminarily designated addresses, and a control part 20 
for controlling the whole device. 
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ABSTRACT 

PURPOSE: To increase the calculation speed by providing plural ring 
networks having the functions of an input layer, an intermediate layer, and 
an output layer and executing the learning function of the back propagation 
method for given patterns in parallel by respective ring networks. 
CONSTITUTION: This device has the multilayered structure consisting of an 
input layer, at least one intermediate layer, and an output layer, and 
plural ring networks A, B, C , and D having respective functions of the 
input layer, intermediate layers, and the output layer execute the learning 
function of the back propagation method for patterns given to these ring 
networks in parallel. Thus, the calculation speed is increased by parallel 
calculation of plural elemental processors , and plural patterns are 
simultaneously learnt in the simulation of a neural network to 

considerably increase the calculation speed. 
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METHOD AND DEVICE FOR FULLY -CONNECTED NETWORK PARALLEL PROCESSING 

PUB. NO.: 03-100755 [JP 3100755 A] 

PUBLISHED: April 25, 1991 (19910425) 
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APPLICANT (s) : NEC CORP [000423] (A Japanese Company or Corporation), JP 
(Japan) 
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ABSTRACT 

PURPOSE: To perform the processing at a high speed by obtaining center 
processing results preliminarily transposed in respective processor modules 
to reduce the processing for special transposition and the number of times 
of data transfer at the time of divisional processing of plural 
processor modules . 

CONSTITUTION: Processings whose number is obtained by dividing b-number of 
intermadiate layers by (n) are assigned to processor modules 1 and 2, and 
partial charge of processings of networks of a-number of input layers and 

c - number of output layers coupled to them are taken by processor 
modules, and a partial sum of output layers is obtained by each of 
processor modules 1 and 2, and thereafter, data is collectively transferred 
to one shared memory 13 to obtain the total sum. The total sum and the 
error obtained from a teacher signal are collectively transferred as data 
to processor modules 1 and 2, and values of weights of networks coupled to 
n-number of intermediate layers are obtained by processor modules 1 and 2 . 

Neural network recognition and learning processing are performed 

without transposition for weight it values of networks on the shared memory 
13. Thus, the processing is performed at a high speed. 
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Employee e.g. insurance agent, hiring system, has keyboard to 
input data 

that is reviewed by decision nodes in model identification 
step, and 

fuzzy interference system is used to review data 
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Abstract (Basic) : US 20040254902 Al 

NOVELTY - The system has a keyboard for inputting data 

that is 

reviewed by decision nodes in a model identification step. 
Artificial 

neural network and fuzzy interference system is used to 
review the 

data. The fuzzy interference uses self organization map, 
native 

bayesian classifier, learning vector quantization, 
probabilistic 

neural network and neural genetic optimizer to review the 
data . 

USE - Used for hiring an employee e.g. insurance agent. 
ADVANTAGE - The system eliminates the need of a new data 

or a new 

instrument, yields a better retention rate and uses leading 

edge 

technologies e.g. fuzzy logic , to score a same selection 
instrument, thus producing clearly superior results. 



DESCRIPTION OF DRAWING (S) - The drawing shows a flow 
chart of a 

system for hiring an employee, 
pp; 9 DwgNo 3/3 
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Abstract (Basic) : WO 200070481 Al 

NOVELTY - Application system having application domain 
stored with 

Bayesian models each relates to entity within domain, and 
set of 

attributes, is coupled to intelligence system. Intelligence 
system 



updates Bayesian models as a function of dynamically 
changing domain 

related information, based on which, real-time prediction and 
recommendations related to application domain is provided. 
DETAILED DESCRIPTION - INDEPENDENT CLAIMS are also 
included for the 
following : 

(a) interference system; 

(b) method for providing prediction and recommendations; 
( c ) machine learning system; 

(d) method of representing and maintaining entities in 
application 
domain 

USE - For intelligence e-commerce computer system for 
enterprise. 

ADVANTAGE - Due to the intelligent system, the enterprise 

system 

has no down-time, operates in real-time, and is structured to 

have 

unencumbered scalability . 

DESCRIPTION OF DRAWING (S) - The figure shows the program 
architecture for the intelligence system, 
pp; 158 DwgNo 2/26 
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...SPECIFICATION factors. In another embodiment, the weight factor is 
computed from learning sets and applying a Bayes classifier or other 
technique . 

In a preferred embodiment, the quality score is determined by first... 
by defining its speed and persistence in a direction (Directed motion) , 
by a diffusion coefficient ( Br own i an motion) , and/or by defining an 
affinity factor, which reflects the effect of nearby cells... 
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Detailed Description 

reverts and the (instantaneous) standard deviation of the process, and 
clZ is the standard normal Brownian motion process. 

I 0 [00351 Extensionsandmodif icationsof thesesimpleformsof mean- reverting 
models have been developed which enable information about ... the relative 
performance of each set of parameter values over time, for example by 
using Bayesian methods, or through another method, for example based on 
a user's changing level of... 
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... known that atoms or molecules of a gas diffuse; that is, the atoms 
perform a Brovmian -motion ...Eq. [6] with F-function from Eq. [12] on 
a pixel-by-pixel basis using Bayesian probability theory with 
uninf ormative prior probabilities, the transverse and longitudinal 
dif fusivities were then obtained from. . . 



11/3, K/8 (Item 8 from file: 349) 

DIALOG (R) File 349:PCT FULLTEXT 

(c) 2005 WIPO/Univentio. All rts . reserv. 

00810341 **Image available** 

IMPROVEMENTS IN OR RELATING TO APPLICATIONS OF FRACTAL AND/OR CHAOTIC 
TECHNIQUES 

AMELIORATIONS RELATIVES A DES APPLICATIONS DBS TECHNIQUES FRAC TALES ET/OU 
CHAOTIQUES 

Patent Applicant /Assignee : 

DURAND TECHNOLOGY LIMITED, River House, 6 Walnut Tree Park, Walnut Tree 
Close, Guildford, Surrey GUI 4TR, GB, GB (Residence) , GB (Nationality) , 
(For all designated states except: US) 
Patent Appl i cant/ Inventor : 

JOHNSON William Nevil Heaton, 1 Brock Terrace, The Grange, St. Peter 
Port, Guernsey GY1 1RT, GB, (Residence) , GB (Nationality) , 
(Designated only for: US) 
BLACKLEDGE Jonathan Michael, Faculty of Computing Sciences and 

Engineering, Dept. of Mathematical Sciences, De Montfort University, 
Leicester LEI 9BH, GB, GB (Residence) , GB (Nationality) , (Designated 
only for: US) 

MURRAY Bruce Lawrence John, Merryfields, Ridgelands, Barcombe, E. Sussex 
BN8 5BW, GB, GB (Residence), GB (Nationality), (Designated only for: 
US) 

Legal Representative: 

HOWDEN Christopher A (agent), Forrester Ketley & Co., Forrester House, 52 
Bounds Green Road, London Nil 2EY, GB, 
Patent and Priority Information (Country, Number, Date) : 

Patent: WO 200143067 A2-A3 20010614 (WO 0143067) 

Application: WO 2000GB4736 20001211 (PCT/WO GB0004736) 

Priority Application: GB 9929364 19991210; GB 9929940 19991217; GB 
2000952 20000117; GB 20006239 20000315; GB 20006964 20000322 
Designated States: 

(Protection type is "patent" unless otherwise stated - for applications 
prior to 2004) 

AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE 
ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT 
LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM 
TR TT TZ UA UG US UZ VN YU ZA ZW 

(EP) AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR 

(OA) BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG 

(AP) GH GM KE LS MW MZ SD SL SZ TZ UG ZW 

(EA) AM AZ BY KG KZ MD RU TJ TM 
Publication Language: English 
Filing Language: English 
Fulltext Word Count: 50073 
Fulltext Availability: 

Detailed Description 

Detailed Description 

... limited range of scales. 

SUBSTITUTE SHEET (RULE 26) 

6.3 Random Practals 

6 1 Classical Browziian Motion 

There are many examples in the field of physics, chemistry and, biology of 
random processes. Brownian motion is a relevant mathematical model for 
many such physical processes. These processes display properties which 
have now been shown to be best described as fractal processes. 

In Brownian motion, the position of a particle at one time is not 
independent of the particles motion at a previous time. It is the 
increments of the position that are independent. Brownian motion in ID 
is seen as a particle moving backwards and forwards on the x. . . 



.6 2, we give an example of a physical process that has been modelled by 
Brownian motion. 

6 2 Diffusion as an Example of Brownian Motion 

For a particle moving in ID (along the x-axis) , consider the following 
model .which is the scaling relation for the probability density. The 
above equation shows that the Brownian process is invariant in its 
statistical distribution under a transformation that changes the time 
scaled. . ,X(t) 
X(to)OCCJt 
tOlH) 0<H<1 

which provides the basis for Fractional Brownian Motion. 

Fractional Brownian Motion is an example of statistical fractal 
geometry and is the basis for the coding. . .This model is a generalisation 
of three distinct PSDFs used for stochastic modelling. 

(i) Fractional Brownian Motion (g = 0,wo = 0) 

(H) Ornstein-Uhlenbeck model (g q 1) 

2 

(iii) Bermarm. . .data whereas this filter is regularized by a constant 
determined by the Lagrange multiplier. 

3. Bayesian Estimation 

The processes discussed so far do not take into account the statistical 
nature of . . . 

.of approach must be taken which is based on a result in probability 
theory called Bayes : rule named after the English mathematician Thomas 
Bayes . 

The probability of an event 

Suppose we toss a coin, observe whether we get heads... q 
P 

Hence, we have 
P(B and A) = P(B)P(A I B) 
Bayes Rule 

The probability of getting A and B occurring simultaneously is exactly 
the same as . . . 

.1 A) - P(B)P(A IB) 
P(A) 

This result is known as Bayes rule. It relates the conditional 
probability of 'B given A' to that of 'A given B' . 

SUBSTITUTE SHEET (RULE 26) 

Bayesian Estimation in Signal and Image Processing 
In signal and image analysis Bayes rule is written in the form 
Pfflp(s I P 
PU I s ) P ( s . . . 

.result is the basis for a class of restoration methods which axe known 
collectively as Bayesian estimators. 

Bayesian estimation attempts to recover f in such a way that the 
probability of getting f . . . PDF is also a maximum when 
a In P(f Is)= 0 
af 

Now, using Bayes rule, we can write this equation as 
a In P(s I f ) + a In. . . 

.is known as the Maximum a Posteriori or MAP method. To illustrate the 
principles of Bayesian estimation, we shall now present some simple 
examples of how this technique can be applied to data analysis. 



SUBSTITUTE SHEET (RULE 26) 
3 9 

Bayesian Estimation - Example 1 
Suppose that we measure a single sample s (one real number) in. . .had a 
Gaussian distribution. 

From the example given above, it should now be clear that Bayesian 
estimation (i.e. the MAP method) is only as good as the a priori 
information. . . 

.where there is a complete lack of knowledge about the statistical 
behaviour of the object. 

Bayesian Estimation - Example 2 
To further illustrate the difference between the MAP and ML estimate and 



. .problem is to find an estimate for a. To solve problems of this type 
using Bayesian estimation, we must introduce multidimensional 
probability theory. In this case, the PDF is a function. . .ML estimate. 

3.1 The Maximum Likelihood Filter 

In the last section, the principles of Bayesian estimation were 
presented. We shall now use these principles to design deconvolution 
algorithms for digital ... filter , Power Spectrum Equalization filter, the 
Matched filter and the Maximum Entropy Method. In addition, Bayesian 
estimation methods have been considered which rely on a priort ' 
information on the statistics (compounded. . . 

. . function f ij . 

The Maximum Likelihood and Maximum a Po-steriort methods are both forms 
of Bayesian estimation. In this report, only Gaussian statistics have 
been considered to illustrate the principles involved. . . 
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Detailed Description 
loan. 

Figure 6 shows the calculation of probabilities in the lattice 
20 by means of Bayes ' rule. In the figure the shown lattice is 
calibrated to a flat yield curve. 

Figure .. .dZ- (t) is a so-called Wiener process. (The process is 

also termed a generalized Brownian motion) . The Wiener process 

is to be seen as the counterpart to a random walk. . .match between the 

remaining debt and the interest rate adjustment amounts. 

25 In the projection, Bayes ' rule is applied for the 
determination of the probabilities. Bayes 1 rule expresses the 
probability of an event having occurred by a specific path as 
probabilities ... 1, 2 ... corresponding to the 
forward induction method. With the definition of the 
cumulative probabilities, Bayes , rule may be formulated. Let 
(2.5) P"((g- 1 t k)l(g, h... 
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... 19k-l - EjAkg(Wk)f (Vk)lgk-l) (7) 
tjAkj9k-ll 

using a version of Bayes 1 theorem (10] . 

Now Ak-1 is 9k- I measurable, therefore 
Efg(wk)f (Vk) j9k. . . i j (M) + bin/ 
E f Jk" 13/ k k Pk (48) 

PROOF. Using the abstract Bayes rule (7) we have 
(M) EjAk H'j (m'lYk) Oij (M) (X) dx 
k. . . in 

January 1997 

dS, 5t )Sldt + a, Stdz, Q) (1) 

Here, z, is a standard Brownian motion, and 6t represents the 
"convenience yield" (which models the value of holdings amounts of... 

...51 = lc(a - i5r)dt + cy,dz, Q) (2) 

Here, Z2 is a second standard Brownian motion with <Zl(t), Z2(t)> = Pt. 



It is convenient to consider the logarithm of. 
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CONTINUOUS BAYESIAN ESTIMATION 
WITH A NEURAL NETWORK ARCHITECTURE 
TECHNICAL FIELD OF THE INVENTION 
The present invention pertains... 

. . .network architecture, and more particularly, to an 
architecture which is designed to perform adaptive, 
continuous Bayesian estimation on unpreprocessed large 
dimensional data, 
BACKGROUND OF TEOE : INVENTION 
Artificial neural systems is the... 

. . .whereas 

another filtering approach, the Kalman-Bucy filter, 
provides continuously evolving estimates, The multi 

stage Bayesian or Continuous Bayesian estimator ...from that shown 
in Figure 6, It is based 

on the more general multi-stage Bayesian estimator as 
described in Ho, Y.C. and Lee, R.C.K., "A Bayesian 
Approach to Problems in Stochastic Estimation and 

Control". I.E.E.E, Transactions of Automation. . .history of its input. 
This is an 

important technicality: A true innovations process is a 
Brownian motion, useless for control or error correction. 



But a suboptimal innovations process can be so. 
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Generator and an input Criterion in an Evaluator. 
simultaneously. 

[01191 An Evaluator implemented as a Bayesian network can 
represent a variety of mathematical calculations, stochastic 

processes , and text concatenations simultaneously . Although 
44 

an Evaluator is defined in the knowledge base, it can 
execute arbitrarily complex. . . 

...one of a Relational 

Condition and a Criterion to define the state of an input 
Bayesian node, and selects the first state in each node 
where the virtual patient has a. . . 
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800) and image processor (900) which in turn are part of or attached 
to a microprocessor controller or computer (I 000) which controls the 
transfer of the digitized images to the... unit area which are constant 
over some period of time. Particles free in solution undergoing brownian 

motion or other types of motion results in variable scattered light 
intensity per unit area... film above the surface. Free particles are 
distinguished from attached particles by their 1 5 Brownian motion 
which is absent in attached particles . hi the following sections we 
describe the details... of light illumination and detection. The material 
appeared homogeneous, the particles moving very fast in Brownian motion 
with a green color. We then removed the coverslip, and placed a drop of 
...peptides, receptors, pharmaceutical agents, hormones and the like. 

iii . Detect ionandCharacterizationofMolecularBindingEvents 

In another illustrative example, the Brownian motion of a particle that 
is coated with a binding agent can be used in. . . 
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"Naive Bayes " node leafs of the induction algorithm group 320 and the 
"Tree Pruning" node leafs of... an ability to execute two or more of the 
KD processes (or a set of processes ) simultaneously . 
Figure 9 shows a functional diagram of an exemplary embodiment of the 
implementation of the... 
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... be used to classify the regions of interest as benign or malignant 
nodules. Bayesian classifiers, neural networks , rule-based methods, 
fuzzy logic or other suitable techniques can be used for 
classification. It should be noted here that... 
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Claim 

... implemented as "tool kits" which are called upon by the algorithm and 
developed by programming, expert systems ,, neural ne tworks, and so 
forth as discussed above. The [k] level of the CAX. . . 

...algorithm can be used to- classify the regions of interest as benign or 
malignant nodules. Bayesian classifiers, lneural networks , 
rule-based methods, fuzzy logic or other suitable techniques can be 
used for classification. It should be noted here that... 
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... rotating speeds. The extracted features are then aggregated, 

quantized, and classified using a variety of artificial intelligence 
techniques, including neural networks , support vectors machine, fuzzy 
adaptive 1 0 resonance theory (" fuzzy- ART" ) , K-nearest neighbor, and 
expert systems , such as fuzzy logic and Bayesian networks . 
Thereafter, a hybrid artificial intelligence technique is used to 
diagnose and/or provide a prognosis for the monitored mechanical system 
...classifiers indicate specific faults, the confidence level is 
decreased. 



As shown in Figure 9, different artificial intelligence techniques 
are used to classify the features of each group according to the related 
knowledge. . . 

.gas path trends, where extensive a priori knowledge is available for a 
rule base, an expert system based on fuzzy or deterministic logic 
522, 532, is employed. Furthermore, where information on probability 
distribution is available, Bayesian Networks may be 
42 

SUBSTITUTE SHEET (RULE 26) 

used. Expert systems employ classification methods that formulate the 
expert knowledge into a classification decision, e.g. decision trees and 
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diagnostic system 10 may construct a diagnostic model utilizing 
model-based or case-based reasoning, Bayesian networks, neural 
networks , fuzzy logic , expert systems or the like. Because 
Bayesian networks can accept reliability data as well as information 
from other sources, such as 
systemic ... 

...for prioritizing suspect components, the extended VOI diagnostic model 
is preferably constructed based upon a Bayesian network that is capable 
of being updated. See, for example, S.L. Lauritzen et a[., Local 
Computations With Probabilities on Graphical Structures and Their 
Applications to Expert Systems , Journal of the Royal Statistical 
Society B, Vol. 50, pp. 

157-224 (1988), incorporated herein... 



21/3, K/30 (Item 30 from file: 349) 

DIALOG (R) File 349:PCT FULLTEXT 

(c) 2005 WIPO/Univentio. All rts. reserv. 

00974194 **Image available** 

DATA INPUT DEVICE 

DISPOS1TIF D» ENTREE DE DONNEES 

Patent Applicant /Assignee : 

KONINKLIJKE PHILIPS ELECTRONICS N V, Groenewoudseweg 1, NL-5621 BA 
Eindhoven, NL, NL (Residence) , NL (Nationality) 
Inventor (s) : 

THOMASON Graham G, Internationaal Octrooibureau B.V. , Prof. Holstlaan 6, 

NL-5656 AA Eindhoven, NL, 
FARRINGDON Jonathan, Internationaal Octrooibureau B.V., Prof. Holstlaan 

6, NL-5656 AA Eindhoven, NL, 
WALKER David P, Internationaal Octrooibureau B.V., Prof. Holstlaan 6, 
NL-5656 AA Eindhoven, NL, 
Legal Representative: 

WHITE Andrew G (agent), Internationaal Octrooibureau B.V. , Prof. 
Holstlaan 6, NL-5656 AA Eindhoven, NL, 
Patent and Priority Information (Country, Number, Date) : 

Patent: WO 200303181 A2-A3 20030109 (WO 0303181) 

Application: WO 2002IB2405 20020620 (PCT/WO IB0202405) 

Priority Application: GB 200115822 20010628 
Designated States: 

(Protection type is "patent" unless otherwise stated - for applications 
prior to 2004) 
CN JP KR 

(EP) AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR 
Publication Language: English 
Filing Language: English 
Fulltext Word Count: 5581 

Main International Patent Class: G06F-003/023 
Fulltext Availability: 
Detailed Description 

Detailed Description 

may be matched on fuzzy 
criteria. Neural networks, Bayesian reasoning, or hidden Markov chains, 
or fuzzy logic may be used to obtain the matching characters for 
selection, for 

example to identify those... 
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welding information. The 
search component 140 can employ various techniques (e.g., based upon a 

Bayesian model, an artificial intelligence model, probability tree 
networks, fuzzy logic and/or neural network ) when searching for 
welding information. The search 1 5 component 140 can search, for example 
...search component 852 can employ various techniques (e.g., based upon a 
Bayesian model, an artificial intelligence model, probability tree 
networks, fuzzy logic and/or neural network ) when searching for 
welding information. The search component 852 can searclijor example, the 
welding information ... search component 940 can employ 

various techniques (e.g., based upon a Bayesian model, an artificial 
intelligence model, probability tree networks, fuzzy logic and/or 
neural network ) when searching for potentially suitable welding 
procedure (s) . 

The design of experiment ( s ) component 950... 
Claim 

... welder (I 04, 804) using one of a Bayesian model, a probability tree 
network, an artificial intelligence model, a fuzzy logic model 
and a neural network . 
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time to compute the probabilities of delay. 
Alternatively, the tardiness model 52 may be a 

machine learning model such as a neural network , support 
vector machine, radial basis function, linear or 
polynomial discriminant function, exponential function, 
decision tree, nearest-neighbor model, classifier system, 
naive Bayes model, fuzzy logic model, genetic algorithm, 
graphical model, or Bayesian belief network which 
expresses a functional mapping between a possible delay 
for a flight and. . . 

...amount of lateness (which may 

5 or may note be quantized into a range) the machine 

learning model producing a probability that the identified 
flight will be delayed by the specified amount... 
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... of Al. What is proposed for the SMDB can be classified under specific 
components of AI : Logical Al, Inference, and Learning from Experience. 
Learning 

from Experience is the area of "smartness" in the SMDB. The tools most 
commonly employed to implement this component are connect ionism, neural 

networks , semiotics, and fuzzy logic . The present invention add the 
use of 

Bayesian Statistics. The Bayesian Method specifically focuses on a 
predictive/learning capability. Moreover, its statistics are very well 
developed. . . 

...tools presently being used in Al . The present invention is not limited 
exclusively to the Bayesian Method for the Learning from Experience 
component of the SMDB, but consider all viable tools... 
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The aim of this thesis is to apply the artificial neural networks 
paradigm to flow routing/control in communication networks based on a dual 
approach: planning and control. The planning approach is related to an open 
loop control where the levels of performance are a priori imposed on the 
structure of the communication networks, while the control approach resides 
in a general closed loop approach where the performance of the system is 
obtained as the result of some adaptation mechanism. 

The main contributions of this thesis can be summarized as follows: 
(1) Setting up the planning, control and layered planning -control 
architectures for different communication flow models with a particular 
emphasis on parallel link switching and trunk group design. (2) Developing 
a stochastic approximation framework for analyzing the switching control 
policies by using Markov decision process and Brownian motion models. 
Periodic control policies for describing the statistically flow switching 
process in ATM networks are considered. (3) The problem of flow planning is 
considered within the frame of aggregation/disaggregation approach for 
large scale Linear Programming models . Lagrangian relaxations for 
capacitated call processing server are considered toward a mapping onto 
dynamical system solvers. The planning/control duality is correspondingly 
emphasised while developing the Hopfield neural network solver as a 
control system based on a sliding modes approach. (4) The stochastic 
approximation development for communication network flow models is 
specifically used to build adaptive flow control schemes based on 
stochastic estimation with feedforward neural networks . The Bayesian 
adaptive control and reference model approaches for mean flow estimation 
through least squares is the main feature. The second feature is given by 
the idea of using a pattern recognition technique over an integrated 
state-control structure in order to synthesize the control by using 
feedforward neural networks . (5) Specific problems from flow 
planning/control design are considered for mapping onto neural networks 
solvers as follows: (a) Dynamic priority assignment within multiple class 
queues; (b) Flow assignment by Hopfield neural networks (at the link 
level); (c) Flow multiplexing in ATM networks based on stochastic 
approximation; (d) Deterministic flow control (at the link level); (e) 
Parameter estimation for routing/ flow control; (f) Adaptive control for 
trunk group flows in ATM networks. (Abstract shortened by UMI . ) 
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Two features distinguish the Bayesian approach to learning models 
from data. First, beliefs derived from background knowledge are used to 
select a prior probability distribution for the model parameters. Second, 
predictions of future observations are made by integrating the model's 
predictions with respect to the posterior parameter distribution obtained 
by updating this prior to take account of the data. For neural network 
models, both these aspects present difficulties — the prior over network 
parameters has no obvious relation to our prior knowledge, and integration 
over the posterior is computationally very demanding. 

I address the first problem by defining classes of prior distributions 
for network parameters that reach sensible limits as the size of the 

network goes to infinity. In this limit, the properties of these priors can 
be elucidated. Some priors converge to Gaussian processes, in which 
functions computed by the network may be smooth, Brownian , or 
fractionally Brownian . Other priors converge to non-Gaussian stable 
processes. Interesting effects are obtained by combining priors of both 
sorts in networks with more than one hidden layer. 

The problem of integrating over the posterior can be solved using 
Markov chain Monte Carlo methods. I demonstrate that the hybrid Monte Carlo 
algorithm, which is based on dynamical simulation, is superior to methods 
based on simple random walks. 

I use a hybrid Monte Carlo implementation to test the performance of 
Bayesian neural network models on several synthetic and real data 
sets. Good results are obtained on small data sets when large networks are 
used in conjunction with priors designed to reach limits as network size 
increases, confirming that with Bayesian learning one need not restrict 
the complexity of the network based on the size of the data set. A 
Bayesian approach is also found to be effective in automatically 
determining the relevance of inputs. 
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Abstract: We develop, analyze, and apply a specific form of mixture 

modeling for density estimation within the context of image and texture 
processing, The technique captures much of the higher order, nonlinear 
statistical relationships present among vector elements by combining 
aspects of kernel estimation and cluster analysis. Experimental results 
are presented in the following applications: image restoration, image 
and texture compression, and texture classification. 
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(Theoretical) 
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Abstract: It is generally assumed when using Bayesian inference methods 
for neural networks that the input data contains no noise. For 
real-world (errors in variable) problems this is clearly an unsafe 
assumption. This paper presents a Bayesian neural network framework 
which accounts for input noise provided that a model of the noise process 
exists. In the limit where the noise process is small and symmetric it 
is shown, using the Laplace approximation, that this method adds an extra 
term to the usual Bayesian error bar which depends on the variance of the 
input noise process. Further, by treating the true (noiseless) input as a 
hidden variable, and sampling this jointly with the network's weights, 
using a Markov chain Monte Carlo method, it is demonstrated that it is 
possible to infer the regression over the noiseless input. This leads to 
the possibility of training an accurate model of a system using less 
accurate, or more uncertain, data. This is demonstrated on both the, 
synthetic, noisy sine wave problem and a real problem of inferring the 
forward model for a satellite radar backscatter system used to predict sea 
surface wind vectors. (Author abstract) 16 Ref s . 
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Abstract: Bayesian belief networks are an important knowledge structure 
for reasoning under uncertainty. In the Most Probable Explanation (MPE) 
problem, also known as the maximum a-posteriori (MAP) assignment problem, 
the objective is to assign truth values to network variables in a way that 
will maximize their joint probability conditioned on the evidence to be 
explained. This problem has recently been shown to be NP-hard for general 
belief networks and for large networks, exact solution methods are not 
practical. In this paper, we present a parallel processing technique, 
particularly suitable for loosely-coupled multicomputers , which combines 
genetic algorithms with simulated annealing. This method is applied to the 
MPE problem on Bayesian belief network and is found to be superior on the 
MPE problem to either genetic algorithms or simulated annealing separately. 
(Author abstract) 12 Ref s . 
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Abstract: Local conditioning (LC) is an exact algorithm for computing 
probability in Bayesian networks, developed as an extension of Kim and 
Pearl's algorithm for singly-connected networks. A list of variables 
associated to each node guarantees that only the nodes inside a loop are 
conditioned on the variable which breaks it. The main advantage of this 
algorithm is that it computes the probability directly on the original 
network instead of building a cluster tree, and this can save time when 
debugging a model and when the sparsity of evidence allows a pruning of the 
network. The algorithm is also advantageous when some families in the of 
the algorithm with a processor for each node is possible even in the case 
of multiply- connected networks. (Author abstract) 29 Refs. 
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Abstract: Automated target detection and cueing (ATD/C) capabilities are 
being developed at Loral for the Radar Detection of Concealed Time Critical 
Targets (RADCON) contract with Wright Laboratory (WL) . The ATD/C algorithms 
use calibrated, fully polarimetric UHF band synthetic-aperture radar data 
collected by the ERIM/NAWC P-3 radar. A brief overview of data collected 
for RADCON algorithm development and testing is presented. An outline of 
the development and evaluation of discriminants used in the context of a 
Bayesian Neural Network (BNN) detector algorithm is described. The BNN 
algorithm was demonstrated under a previous WL concealed target detection 
ATD/C program. These algorithms will be hosted on a near real-time COTS 
parallel processor as part of a FOPEN airborne system. 6 Refs. 
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Abstract: We present a method for automatically determining the structure 
and the connection weights of a Boltzmann machine corresponding to a given 
Bayesian network representation of a probability distribution on a set of 
discrete variables. The resulting Boltzmann machine structure can be 
implemented efficiently on massively parallel hardware, since the structure 
can be divided into two separate clusters where all the nodes in one 
cluster can be updated simultaneously . The updating process of the 
Boltzmann machine approximates a Gibbs sampling process of the original 
Bayesian network in the sense that the Boltzmann machine converges to the 
same final state as the Gibbs sampler does. The mapping from a Bayesian 
network to a Boltzmann machine can be seen as a method for incorporating 
probabilistic a priori information into a neural network architecture, 
which can then be trained further with existing learning algorithms. 
(Author abstract) 21 Ref s . 
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Abstract: Bayesian networks originated as a framework for distributed 
reasoning. In singly connected networks, there. exists an elegant inference 
algorithm that can be implemented in parallel having a processor for every 
node. It can be extended to take advantage of the OR-gate, a model of 
interaction among causes that simplifies knowledge acquisition and evidence 
propagation. We also discuss two exact and one approximate methods for 
dealing with general networks. It will be shown how all these algorithms 
admit distributed implementations. (Author abstract) 25 Refs. 
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Abstract: By replacing the Sigmoid activation function often used in 
neural networks with an exponential function, a probabilistic neural 
network ( PNN) can be formed which computes nonlinear decision boundaries 
which are asymptotically Bayes -optimal. The PNN technique offers a 
tremendous speed advantage for problems in which the incremental adaptation 
time of back propagation is a significant fraction of the total computation 
time. For one application, the PNN paradigm was 200,000 times faster than 
back propagation. Many potential applications exist for neural networks 
of this type. Three recent investigations are discussed here: 1) 
Application of PNN to Hull to Emitter Correlation Problems (ELINT) , 2) 
Application of PNN for Sonar submarine detection, and 3) Analysis of 
underlying causes of satellite communications failures. Excellent results 
were obtained for all three applications. (Author abstract) 9 Ref s . 
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Abstract: Asymptotic methods are introduced that permit computationally 
simple Bayesian recognition and parameter estimation for many large data 
sets that are described by a combination of algebraic, geometric, and 
probabilistic models. The techniques permit controlled decomposition of a 
large problem into small problems for separate parallel processing , 
where maximum- likelihood estimation or Bayesian estimation or recognition 
can be realized locally. These results can be combined to arrive at 
globally optimum estimation or recognition. The approach is applied to the 
maximum- likelihood estimation of 3-D complex-object position. The object is 
modeled as a composite of primitive, simple, quadric 3-D surfaces, and 
parameters for these are estimated separately in parallel. Boundary 
information is also included in the model. The probabilistic framework is 
used to optimally integrate the information obtained from these separate 
estimations. 26 refs. 
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We investigate several issues with regard to the Most Probable 
Explanation (MPE) problem, which is also known as the maximum a posteriori 
(MAP) assignment problem. 

The MPE problem has only been proven to be NP-hard in 1994 (92) . That 
proof leaves open the possibility of finding a polynomial -time constant 
ratio-bounded algorithm for this problem. Unfortunately, we prove that such 
an algorithm cannot exist with any constant ratio bound unless P = NP. We 
also show that this holds for some polynomial ratio bounds. In addition, we 
investigate the complexity of randomized approximation. We prove that a 
polynomial -time algorithm which guarantees any fixed probability of finding 
the optimal solution cannot exist unless RP = NP. 

We prove that the problem of finding a second-best solution given the 
optimal solution is NP-hard. Even approximating the second-best solution 
given the optimal solution is NP-hard. We also investigate dynamically 
changing evidence sets. We find that finding, or approximating, the most 
probable assignment for one evidence set given the optimal assignment for a 
related evidence set is NP-hard even if the two evidence sets are only 
marginally dissimilar. 

Further, we investigate the relationship between the MPE problem and 
the Cost Based Abduction problem (CBA) . In CBA, we are given a set of rules 
with associated numerical costs and a goal to be proved, and the objective 
is to find the lowest cost proof for the given goal. It has been suggested 
by Santos (84) that the MPE problem can be modelled by the CBA problem. We 
prove this relationship by presenting a general method for using any 
heuristic algorithm for cost based abduction to find high probability 
assignments for belief networks. 

We develop a general method, called the UFO method, for hybridizing 
genetic algorithms and simulated annealing on a multiprocessor system. Our 
method is a variation of an algorithm called SAGA; however our method 
requires less synchronization between processors and is thus more suitable 
for loosely coupled processors. We implemented the UFO method on a network 
of SUN work-stations running PVM. We ran experiments with the number of 

parallel processors varying from 1 to 17 . We found that the speedup 
obtained was greater than the number of processors suggesting that our 
hybridization of genetic algorithms and simulated annealing is 
algorithmically superior to either of the two by itself. 

Finally, we investigate the application of recurrent neural 
networks , which have been successfully applied to many optimization 
problems, to the MPE problem. The most popular neural network for 
optimization applications is the Hopf ield network which is a recurrent 
network of quadratic order. The objective function being optimized in the 
MPE problem is generally of high order; the order is equal to the maximum 
in-degree in the network's underlying directed acyclic graph. We applied a 
cubic order generalization of the Hopf ield network, called QNET, to the MPE 
problem for belief networks with a maximum in-degree of 2. Although unlike 
the Hopfield network, the stability and convergence of QNET are not 
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Bayesian belief networks are directed acyclic graphs with nodes 
representing propositional multivalued variables, and directed edges 
representing direct dependencies among the vertices they connect. In 
Bayesian networks, dependence is expressed by means of the D-separation 
criterion. While these networks are superb probabilistic knowledge 
representation tools, they cannot be directly used as inference tools in 
general. The current methodology for building an inference medium is to 
triangulate the directed acyclic graph and form a tree structure whose 
nodes represent the cliques of the triangulated graph. Clique-Trees, due to 
their special running intersection property do not need any independence 
assumptions or extra information for performing coherent belief propagation 
and inference. 

Better performance of systems that undertake these structures and 
techniques relies heavily on the sparsity of the original network and a 
triangulation that takes as small a total state space as possible. 
Intelligent Arc Addition Algorithm (IAAA) introduces a triangulation 
technique that avoids addition of redundant chords during the process of 
triangulation. The Intelligent Belief Propagation (IBP) (also introduced in 
this document) is a technique that can be incorporated into probabilistic 
expert systems for faster response time. The algorithm for utilization 
of parallel processors provides an outline of how the independent 
subtasks within belief propagation can be performed in parallel and hence, 
further improve the system performance. (Abstract shortened by UMI . ) 
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Abstract: A new classifier based on Bayes * principle that assumes the 
clustering of attribute values while boosting the attribute differences is 
presented. The method considers the error produced by each example in the 
training set in turn and updates the connection weights associated to the 
probability P(U/sub m/ C/sub k/) of each attribute of that example. In this 
process the probability density of identical attribute values flattens out 
and the differences get boosted up. Using four popular datasets from the 
UCI repository, some of the characteristic features of the network are 
illustrated. The network is found to have optimal generalization ability on 
all the datasets. For a given topology, the network converges to the same 
classification accuracy and the training time as compared to other networks 
is less. One of the examples indicates the possibility that the 
optimization of the network may be done in parallel (16 Refs) 
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Abstract: Speaker adaptation through Bayesian learning methodology is 
studied in this paper. In order to utilize the cross allophone 
correlations, a Markov random field (MRF) model is proposed as the joint 
prior distribution of the mean vectors of the allophones. Neighborhoods are 
defined as pairs of parameters between which strong correlations have been 
observed previously. Maximum a posteriori estimates of the mean vectors are 
obtained through an iterative optimization technique that converges to the 
global maximum of the posterior distribution. This process is similar to a 
recursive prediction of the parameters, where at each iteration each 
parameter is estimated by a weighted sum of two terms, the first predicted 
by the neighbors and the second by the samples . Further Bayesian 
smoothing of the output distributions is carried out by utilizing some 
simplifications on the functional forms of the marginal posterior 
distributions. The proposed method is fast, consuming only a few CPU 
minutes for processing hundreds of sentences from a new speaker on an 
IBM RS6000 Model 580 system. Experimental results show rapid improvement of 
recognition accuracy. (16 Refs) 
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Abstract: We adapt a competition-based connectionist model to information 
retrieval. This model, which has been proposed for diagnostic problem 
solving, treats documents as "disorders" and user information needs as 
"manifestations", and it uses a competitive activation mechanism which 
converges to a set of disorders that best explain the given manifestations. 
Our experimental results using four standard document collections 
demonstrate the efficiency and the retrieval precision of this model, 
comparable to or better than that of various information retrieval models 
reported in the literature. We also propose a parallel implementation of 
the model on a SIMD machine, MasPar's MP-I. Our experimental results 
demonstrate the potential to achieve significant speedups . (22 Refs) 
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Abstract: Optics has advantages for overcoming limitations arising when 
applying existing electronic technologies to real-time parallel 
computation. In particular, spatial light modulators (SLMs) permit 
simultaneous storage, multiplication, and/or complex interconnection. A 
simple diagnostic expert system uses Bayes theorem to recursively 

update the probabilities of various hypotheses given additional sensor 
input information. The 'a priori' probability matrices are stored in SLMs 
which provide matrix-vector multiplication and interconnection. High speed 
permits the optimum determination of which sensor should be polled next. { 
14 Refs) 
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Abstract: A Bayesian network can be used to represent the deep causal 
knowledge of an agent of a domain expert and turns into a computational 
architecture if the links are used not merely for storing factual knowledge 
but also for directing and activating the data flow in the computations 
which manipulate this knowledge. The first part of the paper defines the 
properties of Bayes networks which are necessary to guarantee 
completeness and consistency, and shows how dependencies and 
conditional-independence relationships can be tested using simple 
link-tracing operations. The second part of the paper deals with the task 
of fusing and propagating the impacts of new evidence and beliefs through 
Bayesian networks in such a way that, when equilibrium is reached, each 
proposition will be assigned a belief measure consistent with the observed 
data. It is first argued that any viable model of human reasoning should be 
able to perform this task by a self -activated propagation mechanism, i.e. 
by an array of simple and autonomous processors, communicating locally via 
the links provided by the Bayes network itself. The author then quotes 
results which show that these objectives can be fully realised only in 
singly-connected networks, where there exists only one (undirected) path 
between any pair of nodes. Finally, the paper discusses several approaches 
to achieving belief propagation n more general networks, and argues for the 
feasibility of turning a Bayes network into a tree by introducing dummy 
variables, mimicking the way in which people develop causal models. 
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ABSTRACT: There are many vision modules in early vision which estimate the 
3 dimensional structure from 2 dimensional image. According to 
Marr(1982), these outputs are integrated into a surface representation 
based on the viewer-centered coordinates in the middle vision. First, 
we examined several types of interaction which were found through 
several psychological experiments. Then, we proposed a new theory of 
the integration between vision modules which is based on the Bays si an 
estimation and simple neural network . Furthermore, we pointed out 
the similarity with Binocular summation and inhibition. Finally, we 
discussed the computation of information integration in the middle 
vision in the general framework of vision modules proposed by Inui and 
Kawato(1992) . (author abst.) 
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The work performed to meet the requirement of this task is a continuing 
effort, evolving toward a general purpose reasoning tool. The idea here is 
to. build a more powerful general expert system than the previous one. 
Towards that, this new Bayesian inference engine is based on the work 
done by Pearl and Kim. The advantages of this new inference engine over the 
previous one are that the representation of the knowledge is more compact 
and the inferencing is suitable for parallel processing . The inference 
engine is written in Franz lisp on VAX machine. All the code and a 
typescript of how to load and use the system is attached. Keywords: 
Computer programming. (KR) 
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This paper presents a methodology for the optimal hydraulic fracture 
treatment design. The methodology includes the construction of a "fast 
surrogate" of an objective function whose evaluation involves the execution 
of a time-consuming computational model, based on neural networks , DACE 
modeling, and adaptive sampling. Using adaptive sampling, promising areas 
are searched considering the information provided by the surrogate model 
and the expected value of the errors . The proposed methodology provides a 
global optimization method, hence avoiding the potential problem of 
convergence to a local minimum in the objective function exhibited by the 
commonly Gauss-Newton methods. Furthermore, it exhibits an affordable 
computational cost, is amenable to parallel processing , and is expected 
to outperform other general purpose global optimization methods such as 
simulated annealing and genetic algorithms. The methodology is evaluated 
using two case studies corresponding to formations differing in rock and 
fluid properties, and geometry parameters. From the results, it is 
concluded that the methodology can be used effectively and efficiently for 
the optimal design of hydraulic fracture treatments. 
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means of a Bayesian methodology of pooling partial knowledge. The 
method has the added advantage that, when the simple models are of a 
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procedures, thereby speeding up the entire parameter estimation process 
by several factors . 

Descriptors—Author Keywords: RECURSIVE LEAST SQUARES ; APPROXIMATION ; ARX 
MODEL ; ESTIMATION 

Research Fronts: 93-3175 001 (PROJECTION PURSUIT REGRESSION; MULTIVARIATE 

SPLINE TRANSFORMATIONS; NEURAL NETWORKS ; FUNCTION APPROXIMATION; 

ROBUST PRINCIPAL COMPONENT ANALYSIS) 
93-7349 001 (SUBSPACE MODEL IDENTIFICATION; SEISMIC RESPONSES OF 2 

ADJACENT BUILDINGS; SPEECH SIGNALS; MULTIPLE INTEGRALS; APPROXIMATION 

ERRORS) 
Cited References: 

DEXTER AL, 1983, V130, P255, IEE PROC-D 

FARSI M, 1984, V20, P913, ELECTRON LETT ' 

FRIEDMAN JH, 1991, V19, PI, ANN STAT 

HARRIS CJ, 1985, SELF TUNING ADAPTIVE 

KARNY M, 1993, MUTUAL IMPACT COMPUT 

KARNY M, 1994, P IFAC S I DENT I F I CAT 

KULHAVY R, 1987, V23, P598, AUTOMATICA 

PETERKA V, 1981, P239, TRENDS PROGR SYSTEM 

SODERSTROM T, 1989, SYSTEM IDENTIFICATIO 

WARWICK K, 1991, ADV METHODS ADAPTIVE 



18/5/45 (Item 5 from file: 34) 

DIALOG (R) File 34 : SciSearch (R) Cited Ref Sci 
(c) 2005 Inst for Sci Info. All rts. reserv. 

03542723 Genuine Article#: PL920 Number of References: 14 
Title: NEURAL - NETWORK MODEL FOR GENERATING SUBJECTIVE CONTOURS 

Author (s) : ISHIDERA E; TSUCHIYA M; TAKAHASHI S; KURITA S; ARAI H; MIYAUTI H 
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Language: ENGLISH Document Type: ARTICLE 
Geographic Location: JAPAN 
Subfile : SciSearch 

Journal Subject Category: COMPUTER SCIENCE, HARDWARE & ARCHITECTURE; 
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METHODS 

Abstract: The human visual system has the ability to recognize a virtual 

line even for a discrete object such as a dot pattern. Even if there is 
no difference in color or brightness, a clear subjective contour can 
still be perceived. This phenomenon can be formulated as an 
interpolation problem. 

This paper proposes a hierarchical visual information-processing 
model based on physiological data. The model then is applied to the 
problem of interpolation, e.g., the perception of a virtual line and a 
subjective contour. To form the subjective contour, the actual outline 
of the visual object, the points comprising the subjective contour and 
the points that move to form a subjective contour must be determined. 
This is achieved by parallel processing in the proposed model which 
is composed of complex cells and hyper-complex cells. 

The complex cells receive the outputs of two kinds of simple cells 
(S and L) , and executes contour detection and interpolation of a dot 
pattern by global processing. The hypercomplex cell detects the end 
point and the point of large curvature through which the subjective 
contour is supposed to pass. All these processes are executed by 
parallel processing . 

When the results of processing are ready, the points comprising the 

subjective contour are determined by weighting. The model in this study 

is constructed to detect the subjective contour as well as the actual 

edge by assembling the information from these hierarchical processing. 
Descriptors — Author Keywords: SUBJECTIVE CONTOUR ; VIRTUAL LINE ; VISUAL 

CORTEX ; NEURAL NETWORK MODEL ; DOG FILTER 
Identif iers- -Keywords Plus: MONKEY VISUAL -CORTEX; PERCEPTION; MECHANISMS 
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45435 

Appl. Opt.; 26 (10) , 1927-1934 (15 MAY 1987) CODEN: APOPA 
CPM: 8706-B-0113 
Work Type: THEORETICAL 
Optics has advantages for overcoming limitations arising when applying 
existing electronic technologies to real-time parallel computation. In 
particular, spatial light modulators (SLMS) permit simultaneous storage, 
multiplication, and/or complex interconnection. A simple expert uses an 
SLM crossbar switch to provide a flexible and fast implementation of 
combinatorial logic. A second expert system , illustrated using medical 
diagnostics, uses the Bayes theorem to updata recursively the 
probabilities of various illnesses given additional symptom information. 
The a priori probability matrices are stored in SLMs which provide 
matrix-vector multiplication and interconnection. Computation of the best 
next symptom question is possible because of the high speed. 
PACS: *42.80.V, 89.80, 42.65. P, 42.80.K 
Descriptors: OPTICAL SYSTEMS; REAL TIME SYSTEMS; EXPERT SYSTEMS ; 
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Document type: Conference paper Language: English 
Record type: Abstract 

ABSTRACT : 

The paper propose a probabilistic case-space metric for the case matching 
and case adaptation tasks. Central to the approach is a probability 
propagation algorithm adopted from Bayesian reasoning systems, which 
allows the case-based reasoning system to perform theoretically sound 
probabilistic reasoning. The same probability propagation mechanism 
actually offers an uniform solution to both the case matching and case 
adaptation problems. The paper aso shows how the algorithm can be 
implemented as a connect ionist network, where efficient massively parallel 
case retrieval is an inherent property of the system. The authors argue 
that using this kind of an approach, the difficult problem of case indexing 
can be completely avoided. 

DESCRIPTORS: ALGORITHM; ARTIFICIAL INTELLIGENCE ; IMPLEMENTATION; 
NETWORKS- -CIRCUITS; PARALLEL PROCESSING ; NETWORK ARCHITECTURE; LEARNING 
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Massively parallel models of computation. Distributed parallel 
processing in artificial intelligence and optimisation 

(Massiv parallele Rechenmodelle . Verteilte Parallelverarbeitung in 
kuenstlicher Intelligenz und Optimierung) 
Barbosa, VC 

Federal Univ. of Rio de Janeiro, Brazil 
1993 

Document type: Monograph Language: English 
Record type: Abstract 
ISBN: 0-13-562968-3 

ABSTRACT : 

This is a book about the parallel simulation by distributed-memory machines 
of massively parallel models of computation within artificial 
intelligence and optimization. The models treated include cellular 
automata, Hopfield neural networks (both analog and binary), Markov 
random fields, Boltzmann machines, Bayesian networks, and other analog 
neural networks specialized in the solution of some mathematical 
problems. The author have intended the book to have a multidisciplinary 
character, so it contains, in addition to the simulation-related material 
and at different levels of detail, a treatment of basic principles of 
distributed parallel program design, of each model's main properties and 
applications, and of how the models relate to one another. This book 
comprises ten chapters and four appendices, grouped into five major parts. 
Every chapter and appendix is complemented by a section with bibliographic 
notes, where comments and directions regarding the bibliography section at 
the end of the book are provided. 
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DISTRIBUTED DATABASES; DATA MEMORY; DISTRIBUTED PARAMETER SYSTEMS; NERVE 
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Real-time neural networks : conjunctoid parallel implementation 

(Neuronale Netze im Echtzeitbetrieb: parallele Imp lemen tier ung der 

Uebereinstimmung) 

Mehta, P; Jannarone, R 

Dept. of Electr. & Comput . Eng., South Carolina Univ., Columbia, SC, USA 

Proceedings. The Twenty-Third Southeastern Symposium on System Theory, 

10-12 March 1991, Columbia, SC, USA1991 

Document type: Conference paper Language: English 

Record type: Abstract 

ISBN: 0-8186-2190-7 

ABSTRACT : 

Conjunctoids are model-based neural networks for categorical data, 
having features that include: generality, with special cases ranging from 
simple perceptron-like linear versions to full-blown versions that account 
for all possible associations among external variables; continuous learning 
and performance, with provisions for optimal updating as each new datum is 
received, based on Bayes decision theory; and separable learning as well 
as performance formulas, with provisions for breaking down necessary global 
computations into parallel components. In the paper, a simple PC 
implementation is described for a full-blown conjunctoid model on a 
small-scale setting. A design and implementation of the model on an NCUBE 
parallel platform and on a special purpose parallel platform are also 
described. 
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Decrementing hamming and Bayesian neural networks : Analog 
implementations and relative performance 

(Reduzierung von Hamming- und Bayes - neuronalen Netzen, analoge 
Implementierungen und relative Leistung) 
Dobson, VG; Salinas, JM 

Dep. of Experimental Psychology, Oxford, GB; Univ. to Granada, E 
Artificial Neural Networks, International Workshop IWANN '91, Granada, E, 
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Document type: Conference paper Language: English 

Record type: Abstract 

ISBN: 3-540-54537-9; 0-387-54537-9 

ABSTRACT: 

A review of recent patent applications indicates that neural networks 
using Hamming-type algorithms with minimum-mismatch selection provide an 
optimal combination of implementational simplicity, information storage 
capacity and signal-noise characteristics. These networks can be adapted to 
implement Bayes ' rule, by setting link gains to the negative logarithm of 
conditional or a priori probabilities. Where probability distributions and 
noise are not uniform or random, the performance of Bayesian classifiers 
may be significantly better than that of the corresponding Hamming network 
on the same vector set. We demonstrate this for the noisy digit 
classification task. We also generate biologically plausible curvature 
detectors for character recognition and compare the performances of 
Bayesian and Hamming networks at classifying the resultant vectors. 
Preliminary results suggest that Hamming networks may provide good 
approximations to the Bayes optimum for sparse natural vector sets under 
s ome c ondi t i ons . 

DESCRIPTORS: NERVE NET; BAYES METHOD; ALGORITHM; S N RATIO; DATA STORAGE; 
CLASSIFICATION; ANALOGUE CIRCUITS; PARALLEL PROCESSING ; COMPUTER 
ARCHITECTURE; NETWORK TOPOLOGY; DISTRIBUTION FUNCTION; PROBABILITY 
DISTRIBUTION 
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PIC Matrices: A Computationally Tractable Class of Probabilistic Query 
Operators . (Statistical Data Included) 

GREIFF, WARREN R. ; CROFT, W. BRUCE; TURTLE, HOWARD 
ACM Transactions on Information Systems, 17, 4, 367 
Oct, 1999 

DOCUMENT TYPE: Statistical Data Included ISSN: 1046-8188 

LANGUAGE: English RECORD TYPE: Fulltext 

WORD COUNT: 13227 LINE COUNT: 01101 

dissertation (Turtle 1990) , developed a probabilistic model for 
information retrieval formulated in terms of a Bayesian Network. The 
inference network is a general framework which makes possible the 
consideration of multiple... 

. . .previously used in the INQUERY system. 
2. INFERENCE NETWORK 

The INQUERY inference network is a Bayesian Network (Charniak 1991; 
Kim and Pearl 1983; Pearl 1988) designed for supporting information 
retrieval. The. . . 

...the proposition that the user's query is satisfied. 
(Figure 1 ILLUSTRATION OMITTED) 
2 . 1 Bayes Nets 

In general, a Bayesian Network encodes a joint probability 
distribution. The nodes ...nodes. As a consequence of the conditional 
independence assumptions implicit in the topology of a Bayesian Network, 
once the probabilities, (p.sub.l), ... , (P.sub.n), have been produced for 
the. . .Alpha) .sub. m+j) = ( (Alpha) . sub. m) + j (Delta) (inverted)Aj =0, ... , 
s, 

then, (inverted) Ai = 0, . . . , s, (inverted)Aj =0, ... , s - i: 
(MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII) 
In particular .. .matrices can be viewed as a generalization of the 
noisy or matrices often utilized in Bayesian Network applications. 

(6) As mentioned in Section 4.3, a linear time version of the... 

...1992. The INQUERY retrieval system. In Proceedings of the 3rd 
International Conference on Database and Expert Systems Applications 
78-83. 

CHARNIAK, E. 1991. Bayesian networks without tears. AI Mag. 12, 4 
(Apr.), 50-63. 

COOPER, W. S. 1994. The formalism of probability theory. . .and 
diagnostic reasoning in inference systems. In Proceedings of the 8th 
International Joint Conference on Artificial Intelligence (Karlsruhe, 
Germany) 190-193. 

LEE, J. H. 1995. Analyzing the effectivness of extended Boolean 
models those produced by the PIC-EVAL algorithm, then .( inverted) Ai =0,1, 
... , n, 

(MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII) 
PROOF. This lemma is proved by... 

...arithmetic progression, there exists a simplified expression for the 
value of key elements of the array computed as part of the PIC-EVAL 
algorithm. In other words, if when the coefficients... 

...can be effected as part of the PIC-EVAL algorithm. 

LEMMA 1. Given a PIC matrix whose coefficients, 

( (Alpha) .sub. m) , ( (Alpha) . sub .m+1 ) , ( (Alpha) . sub. m+2 ) , ... , 

( (Alpha) .sub. 

.. .Alpha) .sub. m+j ) = ( (Alpha) . sub .m) + j (Delta) (inverted)Aj = 0, ... , s, 



then, (inverted) Ai = 0, . . . , s, (inverted) A j =0, ... , s - i 
(MATHEMATICAL EXPRESSION NOT REPRODUCIBLE IN ASCII), 
PROOF (BY. . . 
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PR Newswire, pNA 
April 25, 2000 

Language: English Record Type: Full text 
Document Type: Newswire; Trade 
Word Count: 797 

... features of Genio Miner include: 

- Integrated data acquisition and cleansing functionality 

- Enhanced Predictive Models 

- Naive Bayesian with boosting 

- Symbolic Nearest Mean(SNM) a variant of the K-th Nearest Neighbor 

- LVQ (Learning Vector Quantisation) 

- Multi-Layer Perceptron predictive model ( neural net ) 

Fuzzy Logic 

- Clustering Methods 

r Kohonen self -organised map 

- Gaussian Mixture ( Expectation Maximization) 

- K-raeans 

- Decision Trees including... 
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FUZZY LOGIC AND FLEXIBLE CONTROL: Just how fit for control is fuzzy logic - 
how can neural nets help? What's available? What can it do for you? 

Control and Instrumentation, p44 
June, 1995 

Language: English Record Type: Fulltext 
Document Type: Magazine/ Journal ; Trade 
Word Count: 2830 

... time control, but can ideally sit in the background, gently 

governing the direction of a fuzzy logic controller (which is very fast) 
in the foreground. 1 

Neural net auto-tuning 

In fact, with both Yokogawa's and Siemens' systems, tuning is 
currently by . . . 

...line trial and error. Omron is among the few to have launched fuzzy 
systems involving neural nets - its 'third generation neuro-fuzzy' was 
introduced last year. And, the Math Works also introduced... 

...the fuzzy sets. It harnesses fuzzy logic to capture knowledge and run 
the controls, while neural nets map the data to the output, and thus 
provide tuning. Basically, the nets learn from. . .unrealistic for these. 

Fuzzy set theory, arguable traceable back to the 18th Century and 
Thomas Bayes (probabilistic reasoning) , but actually defined by Prof 
Lofti Zadeh at the University of California in 1965 (although still 
virtually unused until the early' 80s), softens all this. With fuzzy 
logic there's a grade of membership (GM) to a set - or several sets. So, 
both... 

...rules convert your experience into a mathematical equivalent with which 
computers (or microcontrollers) can work. 

Fuzzy logic rules are not difficult to write. They're intuitive 
and in English, like 'If the... 

. . .you a graphical interface, letting you express the rules you identify in 
a fuzzy association matrix (FAM) . In a single parameter controller, for 
example, the FAM covers the fuzzy error and... 

... on the two axes . The outputs are then in the row and columns of the 
matrix . These outputs can be expressed either also as fuzzy variable 
(valve open, half open, half... 

...when it comes to controlling . systems that are poorly defined, non 
-linear or time-variable, fuzzy logic has a lot to offer - certainly 
more than PID! But, they can also cope better than many other advanced 
control alternatives - such as expert . systems and model -based 
predictive systems which require precise treatment. 
And, hence all the interest in. . . 
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MindWizard 3.0: Inexpensive Expert System Creation. (Richter Paradigm Corp 
MindWizard 3*0 low-cost modeling program) (Product Announcement) 

Gliedman, John 

Computer Shopper, vl8, n5, p3 81(l) 
May, 1998 

DOCUMENT TYPE: Product Announcement ISSN: 0886-0556 LANGUAGE: 
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... you get what you pay for. At $149, MindWizard is by far the least 

expensive expert - system program available that provides full support 
for OLE Automation. Using MindWizard, developers and programmers can easily 
build compact expert systems ranging from simpler models that 
incorporate their business-decision rules to highly sophisticated models. 
The. . . 

. . .a bank uses to determine eligibility for a mortgage, complex shape 
identification programs that use fuzzy logic , or stock-market 
forecasting systems that incorporate Bayesian probability. And thanks to 
OLE Automation support, MindWizard models can process the data from a... 
...dragging the mouse to the reasoning or output cell that receives the 
data . 

MindWizard 1 s neural network terminology takes some getting used to 
as well; MindWizard uses terms like "Threshold Potential Stimulus... 

...Simulation programs such as the $700 Micrografx Optima 2.5 provide you 
with a rich array of tools for generating imaginary real-world data and 
help you experiment with ways of . . . 

...from its lack of solid documentation, MindWizard does its job of 
fulfilling the needs of expert - system developers. What it lacks, like 
better built-in support for exchanging data with Excel and. . . 

. . .add with a forthcoming, more expensive version. Meantime, MindWizard 
3.0's greatest strength remains expert systems . Therefore, it can be 
strongly recommended to companies that are willing to spend time and. . . 
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Artificial intelligence (AI) has been heralded as the next 
revolution • in software by some experts in. . .of the brain by establishing 
recognition of particular inputs and producing the appropriate output. 
Neural networks are not "hard-wired" in a particular way; instead, they 
are trained using presented inputs to establish their own internal weights 
and relationships guided by feedback. Bayesian networks resemble neural 
networks in their causal nature and variable dependency. The probabilities 
in a Bayesian network are roughly analogous to the internal weights in a 
neural network . Neural networks , however, are free to form their own 
internal workings and adapt on their own. 

A fuzzy system can use a neural network to adapt to the desired 
outputs of the end user or changing operating conditions. For... 

...papers regarding Bayesian networks and probabilistic reasoning. 
www.afit.af.mil/schools/en/eng/labs/ ai / ai .html 
Air Force Institute of Technology Artificial Intelligence 

Laboratory. This site includes pointers to many disciplines of AI , 

including Bayesian networks. 

ic-www . arc . nasa . gov/ ic /pro j ec ts /bayes- group 

Bayesian Model-Based isis . ecs . soton . ac . uk/research/nf info/neural .html 
A large collection of neural network resources. 
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Autonomy's ActiveKnowledge and Portal-in-a-Box, Oracle's namesake database, 
and Microsoft's Office and Excel are highlighted in a discussion of 
Autonomy's research and development efforts toward making computers 
understand context. Autonomy's research involves new software components 
using the math concepts developed by Thomas Bayes . According to founder 
Michael Lynch, Autonomy's goal is to be 'the Oracle of unstructured data.' 
Autonomy specializes in knowledge management and its ambitions are in 
personalized online services and the management of the exponential growth 
of information in text form. Bayes ' formulae allow computers to perform 
as if they were capable of context comprehension, generalization from words 
to an idea, and comprehension of the unspoken by understanding the root 
foundations of syntax. According to Bayes ' theorem , phenomena observed 
in the present (evidence) can be related to phenomena known to have 
occurred in the past (prior) and to ideas about what is going to happen 
(model) . Doctors use Bayesian exercises in pattern recognition when they 
relate probabilities and beliefs to observations that are part of a 
knowledgeable judgment. Other software products in which Bayesian rules are 
used are Microsoft Wizards, Microsoft.com (in diagnoses of users' PC 
application problems), and Microsoft's continual computation, which 
anticipates a user's next action. 
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BAE Systemsk LEARRNN, Axenon's Vindax, and fuzzyTech from inform are 
highlighted in a discussion of the ways in which fuzzy logic and neural 
nets that can improve engineering design. BAE Systemsk LEARRNN and Nexus 
PDK are among components of a neural network that allow the use of 
design tools from Celoxica, an electronic design automation (EDA) vendor. 
fuzzyTech from Inform is a leading source in Europe of software-based 
technology for fuzzy logic system design. Several editions of fuzzyTech are 
available that provide a suite of analysis and editing functions for design 
of a comprehensive fuzzy-control system. LEARRN software uses a weightless- 
neural network method on neural networks that have only logic 
values, and Vindax is a processor the implementations a neural - network 
design to control complex and nonlinear systems on logic-based array of 
parallel processing elements. Fuzzy logic and neural networks remain 
useful in engineering design, and, although the two are fundamentally 
unrelated, they both offer control methodologies for handling extensively 
nonlinear or badly specified problems. They support circuit techniques and 
conventional computing that imitate human responses and abilities as a way 
to address various design engineer problems. Fuzzy logic, in spite of its 
name, does not indicate imprecision, but instead can return precise 
responses by allowing jsystems built around Boolean logic, handling binary 
values, to work with imprecisely defined values that you might express 
verbally as jmore,k 'less, 'high, ' 'low,' and so on. Among topics covered 
are implementation of a fuzzy logic system; the purpose of neural 

COMPANY NAME: BAE SYSTEMS (745634); INFORM GmbH (552003); Axeon Ltd 

(760005) 
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An 'artificial neural network (ANN) ' is defined as a 'means of 
processing complex data using multiple interconnected processors and 
computing paths.' Artificial neural networks can learn and analyze 
large and complicated datasets that cannot be processed with more linear 
algorithms. The first ANN was invented in 1958 by a psychologist who wanted 
to model the way in which the human brain processes visual data and learns 
to recognize objects. Artificial neural networks also can be used for 
other tasks, since their pattern-matching and learning abilities allow 
users to analyze many problems that are either very difficult or impossible 
to solve with standard computational and statistical methods. ANNs are 
often called simply neural networks , but the name comes from the 
biological brains from which they were first modeled. An artificial neural 

network creates connections among many separate processing elements, 
each of which corresponds to one neuron in a biological brain. The neuron 
receives many input signals and then uses an internal weighting system to 
generate one output signal that is usually sent to another neuron. ANNs 
learn in two separate ways, based on the problem to be solved. A 
self-organizing ANN (Kohonen) is exposed to more data and can find patterns 
and relationships. A back-propagation ANN is trained by humans to conduct 
particular tasks, and during training the teacher judges the correctness of 
the output . 
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This discussion of auto-categorization products defines the new type of 
program as software that assigns documents according to subject matter 
categories based on many techniques, including Bayesian analysis, 
clustering of documents based on similarities, advanced vector machines 
that represent every word and its frequency with a vector, neural 
networks , advanced linguistic inferences, use of pre- existing sets of 
categories, and seeding categories with keywords. Auto-categorization 
software started in the news and content provider area and is still most 
successful and sophisticated in that market. Many companies offer 
auto-categorization software, and most claim that their approach is the 
best, fastest, and most intelligent. The information profession has to 
evaluate the pluses and minuses of auto-categorization, which is not an 
easy task. Auto- categorization software provides metadata generation, or 
document categorization and keyword searching related to the category. 
Another feature provided by some vendors is noun-phrase extraction. A new 
market for auto-categorization is intelligence, with such companies as 
Stratify, H5Technologies , and Inktomi providing products. Among features 
needed by the intelligence industry is Bayesian statistics, but any 
presently used categorization method can be made better and more economical 
with the addition of auto- categorization software. 
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